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Abstract 

Aim: The Cochrane Skin Group (CSG) is part of the international Cochrane Collab- 
oration (http://www.cochrane.org/). The CSG prepares, maintains and disseminates 
high quality evidence-based summaries on the prevention, diagnosis and treatment 
of skin diseases. We present a synopsis of the history, scope and priorities of the 
CSG. In addition, we report outcomes of CSG reviews and critically assess clinical 
value. 

Methods: Descriptive analysis of systematic reviews published by the CSG since 
its inception including output, impact factor, associated methodological studies, 
and influence in clinical guidelines, promoting patient and public engagement and 
in triggering new primary research. 

Results: The CSG started in 1997, and has published 61 reviews, 34 protocols and 
31 registered titles by August 2013. The CSG scope includes 1000 skin diseases; 
80% of reviews cover the top ten diagnoses and 40% of reviews provide clear 
guidance for clinical practice. CSG reviews had an impact factor of 6.1 in 2011 
which places it alongside top dermatology journals. CSG reviews are typically broad 
in focus and have been shown to be of better quality than non-Cochrane reviews. 
They are highly cited in clinical guidelines. Several reviews have identified evidence 
gaps that have led to better primary research. 

Conclusions: The CSG has emerged as a vanguard of evidence-based dermatology 
by growing a community interested in applying best external evidence to the care of 
skin patients and by identifying topics for research. CSG reviews are high impact, 
clinically relevant and have tangibly influenced international dermatology clinical 
practice guidelines and new research. 



Introduction 

To celebrate the 20 lh anniversary of The Cochrane Collabo- 
ration, it would be remiss not to start by honoring the Col- 
laboration's namesake: Professor Archie Cochrane. In 1979, 
Cochrane declared: "It is surely a great criticism of our pro- 
fession that we have not organized a critical summary, by 
specialty or subspecialty, adapted periodically, of all rele- 
vant randomized control trials" (1). Professor Cochrane's 
bold declaration provided a new rctison d'etre for modern 
evidence-based medicine to integrate the best external evi- 



dence in the care of individual patients according to specific 
areas of health such as skin diseases. Today, Cochrane sys- 
tematic reviews have become a gold standard in informing 
evidence-based medicine. Cochrane Reviews have diversi- 
fied beyond simple reviews of therapeutic interventions to 
also include reviews of the accuracy of diagnostic tests and 
other products such as overviews of families of related sys- 
tematic reviews, accompanied by a body of cutting edge 
methodology needed to support these advances. Cochrane's 
legacy has had a profound impact on all medical specialties, 
including dermatology. 
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The Cochrane Skin Group: Origins, 
Scope, and Priorities 

In 1992, Iain Chalmers published an editorial in The British 
Medical Journal advocating the need to get to grips with 
Archie's Cochrane agenda (1). One of the authors of the 
present article (HCW), a trainee in epidemiology at the time 
inspired by Chalmers 'editorial wrote to him, supporting his 
call for summarizing systematically what was already known 
in dermatology. Chalmers' response was immediate, wel- 
coming, and encouraging. As a result, a collection of people 
interested in evidence-based dermatology and systematic re- 
views gathered over the next four years until a critical mass 
formed, resulting in an exploratory meeting in 1996 with 
view to forming a Cochrane Skin Group (CSG). Preparation 
and engagement with a range of stakeholders including pa- 
tients at that exploratory meeting was key, and the minutes 
are still posted on The Cochrane Collaboration website as an 
exemplar of how to get a group started. Iain Chalmers him- 
self contributed to the meeting, along with his brother Robert 
Chalmers, a dermatologist who has been an active member 
of the CSG ever since. 

On the 12 September 1997, the CSG officially registered 
with The Cochrane Collaboration. The CSG aims to dissem- 
inate evidence-based guidelines to prevent, diagnose, and 
treat dermatological disease. Over the last 16 years, the CSG 
has emerged as a vanguard of evidence-based dermatology 
and dermato-epidemiology on an international scale (2-A). 

The CSG will review any aspect of skin disease man- 
agement of value to professionals or to lay people with an 
interest in skin disease. The scope includes reviews ranging 
from life-threatening melanoma skin cancer, through around 
1000 skin conditions, such as eczema, acne, and vitiligo, to 
areas that are considered by some to be simply cosmetic in 
nature, such as skin damage due to the sun. 

Sometimes, other Cochrane groups also produce reviews 
relevant to dermatology due to the broad nature of our field. 
For example, the Cochrane Wounds Group has published 
reviews covering leg ulcers and treatments for scars such 
as keloids. A robust system is in place within The Cochrane 
Collaboration to ensure that all newly proposed titles for pos- 
sible reviews are circulated to all groups, in order to initiate 
constructive dialogue between groups on how to avoid unin- 
tentional overlap and how a review of a multisystem disorder, 
such as systemic lupus, can be best supported. 

In identifying and prioritizing topics for new reviews, the 
CSG considers the following: (i) the impact of the condition 
on people's lives (which may be psychological as well as 
physical); (ii) the knowledge gap in treating this condition; 
(iii) whether there any other good systematic reviews already 
on the subject; (iv) what a Cochrane Review would add to 
what is already known; (v) an assessment of the pace of 
the field and quality of the evidence on the subject; and 



(vi) whether the topic is of current debate or public health 
importance. 

The CSG's editorial process is rigorous and has previously 
been discussed in depth by Williams et al and Leonard, De- 
lamere, and Murrell (2, 5). 

Outcomes of the CSG 

As of August 2013, the CSG has 61 reviews, 34 protocols, 
and 31 registered titles. We performed a citation analysis 
of all CSG papers published in The Cochrane Library us- 
ing Google Scholar. Of the 61 reviews published to date 
(including updates), there are more than 2800 citations. Ta- 
ble 1 presents the top 12 cited CSG papers and their key 
findings (6-17). Since the inception of the CSG, nearly 800 
authors have contributed to our reviews. 

Impact 

How do me measure the impact of the CSG? 

One traditional metric is the Thomson Institute for Scientific 
Information's journal impact factor. The impact factor for the 
CSG has been steadily increasing in recent years. In 2010, 
it was 6.0 and in 2011, it was 6.1. To provide some context, 
the top journal in the field of dermatology, The Journal of 
Investigative Dermatology, had an impact factor of 6.3 in 
2011. So, it appears, from an editorial standpoint, that the 
CSG is publishing papers that are highly cited in the der- 
matology field vis-a-vis other dermatology journals. Yet, the 
impact factor metric alone maybe an imprecise measure of 
actual clinical 'impact' on dermatology practice, as it does 
not measure quality or relevancy of articles (18, 19). 

Is the CSG producing high-quality reviews? 

A study by Collier et al in 2006 concluded that CSG reviews 
are of higher quality than non-Cochrane dermatology system- 
atic reviews (20). The authors determined the methodologi- 
cal quality of Cochrane and non-Cochrane reviews, using the 
10-item Oxman and Guyatt scale to assess quality (20). The 
study revealed that Cochrane Reviews were more likely than 
non-Cochrane reviews to include a comprehensive search 
strategy, minimize selection bias, and appropriately assess 
the validity of all included trials (20). Additionally, Cochrane 
Reviews more frequently included quality of life and adverse 
outcomes data compared to non-Cochrane reviews (20). 

Since the central Cochrane Editorial Unit introduced the 
MECIR (Methodological Expectations of Cochrane Inter- 
vention Reviews) standards for conducting reviews in 201 1, 
and for reporting reviews in late 2012, the CSG has been keen 
to encourage their use by authors. All members are aware of 
the new standards, and links to the expectations are in the 
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standard informative material that the CSG sends to all new 
authors. 

Are CSG reviews relevant to clinical 
practice? 

A common criticism of Cochrane Reviews is that they are 
long and complicated and commonly end up with a bottom 
line of 'insufficient evidence', which even if strictly true, 
most clinicians and patients find unhelpful. In 2004, Parker 
and colleagues sought to address the question "What's the 
point of databases of reviews in dermatology if all they com- 
pile is insufficient evidence" (21)? By assessing the number 
of reviews relevant to dermatology on The Cochrane Library 
at the time, and whether those reviews reported sufficient 
evidence to guide clinical decision-making (21). They found 
that 80% of reviews relevant to dermatology covered the top 
10 diagnoses and that 40% of the reviews provided sufficient 
evidence to guide clinical practice (21). 

Consistent with Parker et al, a study published in 2013 by 
Davila-Seijo, Batalla, and Garcia-Doval found that 'most of 
the systematic reviews published by the CSG provide useful 
information to improve clinical practice' (22). The authors 
performed a bibliometric analysis of all systematic reviews 
published by the CSG through August 2012. Their analysis 
graded 55 CSG reviews into three categories: 'Not useful 
in clinical practice: insufficient evidence to support or reject 
the use of an intervention', 'Useful: insufficient evidence to 
support or reject the use of an intervention, but sufficient 
evidence to support recommendations or suggestions', and 
'Very useful: strong evidence to support or reject the use 
of an intervention' (22). They classified 25.5% (14/55) as 
not useful in clinical practice, 45.5% (25/55) as useful, and 
29.1% (16/55) as very useful (22). Even when studies are 
not considered useful in clinical practice, when evidence is 
lacking, 'Cochrane reviews identify gaps in knowledge and 
help frame the future research agendas' (5). Nevertheless, it 
appears that the majority of systematic reviews published by 
the CSG provide useful information in guiding dermatology 
clinical practice (20, 22). 

Is the CSG changing dermatology clinical 
practice and guidelines? 

Table 2 presents five notable examples of CSG reviews that 
have influenced dermatology clinical practice and guide- 
lines (14,23-26). The CSG is having a tangible effect on 
international dermatological health policy including guide- 
line contributions to the United Kingdom's National Institute 
for Health and Clinical Excellence and the National Health 
Service, the Scottish Intercollegiate Guidelines Network, the 
British Association for Dermatology and the American As- 
sociation of Dermatology. 



Additionally, the juxtaposition of the CSG alongside the 
UK Dermatology Clinical Trials Network (UKDCTN) at the 
Centre of Evidence Based Dermatology in Nottingham, UK, 
has led to new studies initiated by the UKDCTN on the 
basis of research gaps identified from CSG research. As an 
example, the current international clinical trial of tetracycline 
versus prednisolone for bullous pemphigoid arose from a 
Cochrane Review on this topic (27). 



Dissemination of CSG reviews to the 
dermatology community and public: a need 
for partnerships 

The CSG is keen to encourage dissemination of informa- 
tion about our reviews to ensure that it reaches a broad 
global audience of dermatologists, scientists, policy mak- 
ers, and patients. Recently, the CSG initiated co-publishing 
agreements for publishing abridged versions of our reviews 
with two of the most widely read clinical dermatology jour- 
nals: The Journal of the American Academy of Dermatology 
and The British Journal of Dermatology. Additionally, the 
CSG manages a website to disseminate research activities 
(www.skin.cochrane.org). We are also exploring increasing 
our social media presence as this is an emerging area to 
disseminate public health information (28). Opportunities 
may exist to increase our presence on Facebook and Twit- 
ter, as well as to provide author podcasts of recent CSG 
reviews (29). 

The CSG is very interested in promoting patient advocacy 
and involves patients with skin diseases and their families 
(consumers). The majority of dermatological trials have fo- 
cused on questions relevant to academic research and phar- 
maceutical companies, and these trials miss an important 
opportunity to seek patient's perspectives, especially with 
regard to nonpharmacological interventions such as educa- 
tion or specialized clothing. Patient perspectives on choice 
of appropriate outcomes, for example, are important, and 
increase awareness among researchers to improve interven- 
tions especially in areas such as adherence to medication and 
treatment satisfaction. About 100 active consumers are mem- 
bers of the CSG and are involved at many levels. Initially, the 
National Eczema Society and the Vitiligo Society of the UK 
provided the majority of our consumers. But, today, since we 
always include a relevant consumer in the peer-review pro- 
cess and often as a co-author on CSG reviews, many other 
patient advocates have joined the CSG. 

The CSG is also active in developing global alliances. Cur- 
rently, we have a satellite group in France and are initiating 
another in the United States. We are also interested in continu- 
ing to expand participation by individuals in low- and middle- 
income countries and to increase reviews on evidence-based 
dermatology guidelines relevant to resource-limited settings. 
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Table 2 Notable examples of Cochrane Skin Reviews that have influenced clinical practice and health policy 



CSG Title/reference 



Influence on clinical practice and health policy 



Interventions for bullous 

pemphigoid (14) 
Topical treatments for 

chronic plaque psoriasis 

(23) 

Interventions for 
non-metastatic squamous 
cell carcinoma of the skin 
(24) 

Anti-streptococcal 

interventions for guttate 

and chronic plaque 

psoriasis (25) 
Safety of topical 

corticosteroids in 

pregnancy (26) 



British Association of Dermatologists' guidelines for the management of bullous pemphigoid 2012. Br J 
Dermatol 2012; 167(6): 1200-14. 

National Clinical Guideline Centre; National Institute for Health and Clinical Excellence. Psoriasis: 
assessment and management of psoriasis. London: National Clinical Guideline Centre, Royal College of 
Physicians; 2012. (NICE CG153). [Issued October 2012]. Available from URL: http://guidance.nice.org.uk 

NHS Evidence update of the NICE skin cancer guidelines: Williams HC, Bath-Hextall F, Dewar D, Kelly C, 
Lansbury L, Lear J, Newton-BishopJ, Schofield J. Improving outcomes for people with skin tumours 
including melanoma: Evidence Update October 201 1 . National Institute for Health and Clinical Excellence, 
October 201 1 . Available from URL: http://www.evidence.nhs.uk/topic/skin-cancer 

Scottish Intercollegiate Guidelines Network (SIGN). Diagnosis and management of psoriasis and psoriatic 
arthritis in adults. Edinburgh: SIGN; 2010. (SIGN publication no. 121). [cited 12 Oct 20101. Available from 
URL: http://www.sign.ac.uk 

American Association of Dermatology guideline on treatments for pregnant women with psoriasis: Bae YS, 
Van Voorhees AS, Hsu S, Korman NJ, Lebwohl MG, Young M. Review of treatment options for psoriasis 
in pregnant or lactating women: from the Medical Board of the National Psoriasis Foundation. J Am Acad 
Dermatol 201 2; 67(3): 459-77. 



Challenges, Opportunities, and 
Future Plans 

Editorial process 

Our process for registering a review title requires a new 
review team to include an experienced Cochrane author who 
has previously led a Cochrane Review, a methodologist or 
statistician, a content expert, a consumer, and an author with 
a good command of written English. This requirement has 
been in place for some years but has not been sufficient 
to ensure that all reviews progress to an acceptable standard 
within the agreed timelines. More recently, the CSG Editorial 
Base has introduced a categorization system where authors 
of submitted protocols (and subsequent reviews) are given an 
indication of whether their work is immediately acceptable 
to be sent to the referees or whether they need to make minor 
or major changes before it can be go to this step. If these 
requirements cannot be met at the protocol stage, this may 
be an indication the review team is not able to produce a 
quality review. 

We would like to see the CSG become more selective with 
its content. To do this, it will be necessary to occasionally 
say 'no' to reviews that are not good enough — just as other 
journals turn down submissions. 

Discourage reviews of limited focus and 
interest 

The CSG has always steered authors away from very narrow 
topics of limited usefulness, and instead encouraged broader 
review titles, such as 'Interventions for . . . ' However, sub- 
sequent updates of these broad reviews can become too large 
and unmanageable for review authors, referees, the Editorial 



Base, and readers. Updated reviews such as 'Interventions 
for vitiligo' grew from 19 included trials in 2007 to 57 trials 
in the 2010 update. The recently updated 'topical treatments 
for chronic plaque psoriasis' included 190 studies in the 2013 
update. A challenge for the future is how to continue to pro- 
duce reviews that assess broad topics in a manageable way. 

Identifying priority topics 

We wish to evolve the prioritization process to encourage 
reviews on areas that have significant human implications 
and financial costs to healthcare providers, as well as orphan 
diseases and those that represent current dilemmas. We want 
potential review teams to 'bid' for these priority titles, ex- 
plaining why their team is best suited to complete the review 
to a high standard in a timely way. 

Promote reviews of dermatology therapies 
of relevance to the developing world 

Our group is also conscious of the need to cover skin condi- 
tions that commonly affect people in low- and middle-income 
countries as exemplified by our two reviews on cutaneous and 
mucocutaneous leishmaniasis (30,31). One of which 'inter- 
ventions for American cutaneous and mucocutaneous leish- 
maniasis' won the Pan American Health Organization prize 
in 2010, because of its relevance to the Health Agenda for 
the Americas as it addressed a neglected tropical disease. 

We also wish to strengthen our global health collaborations 
with bodies such as the World Health Organization and the 
Institute for Health Metrics and Evaluation at the University 
of Washington (that produces the Global Burden of Disease 
Survey). 
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Conclusion 

The CSG has been a key driver for promoting and produc- 
ing evidence-based dermatology summaries over the last 13 
years. CSG reviews are high impact, clinically relevant, and 
have tangibly influenced international dermatology clinical 
practice guidelines. Expanding into new areas of research 
including those relevant to the developing world, and in- 
creasing dissemination of our results via social media will be 
important future growth areas for the Group. 
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